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Abstract 

In [B. Derrida, and D. Stauffer, Phase Transitions in Two-Dimensional 
Cellular Automata. Europhys. Lett. 2 (1986) 739], a mean field study of the 
iViT-Kauffman Networks was done. They obtained a phase transition curve 
K c 2p(l — p) = 1 (0 < p < 1) for the critical average connectivity K c in 
terms of the bias p of extracting a "1" for the output of the automata. Val- 
ues of K bigger than K c correspond to the so-called chaotic phase; while 
K < K c , to an ordered phase. In [F. Zertuche, On the robustness of NK- 
Kauffman networks against changes in their connections and Boolean func- 
tions. J. Math. Phys. 50 (2009) 043513], a new classification for the Boolean 
functions, called Boolean irreducibility permitted the study of new phenom- 
ena of A^C-Kauffman Networks. In the present work I study, once again the 
mean field treatment for iVi^-Kauffman Networks, correcting it for Boolean 
irreducibility. A new phase transition curve is founded. In particular, for 
p = 1/2 the predicted value K c = 2 by Derrida & Stauffer changes to 
K c = 2.62140224613 .... 



Short title: Boolean Irreducibility and Phase Transitions 

Keywords: Cellular automata, Boolean irreducibility, binary functions, phase 
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1. Introduction 



iVif-Kauffman networks have been widely studied due to its applications 
in theoretical biology; specially they are useful for the study of the genotype- 
phenotype map \I/ I 1-4 !. As long as they are randomly constructed, they are 
well suited for study with statistical techniques; particularly by the use of 
the mean field approximation. 

A iV/T-Kauffman network consists of N Boolean variables Si(t) e Z 2 
(i = 1, . . . , N), which evolve deterministically in discrete time t — 0, 1, 2, . . . 
according to Boolean functions on K (0 < K < N) of these variables at the 
previous time t — 1. For every site i, a i^-Boolean function : — > Z 2 is 
chosen randomly and independently with a bias probability 

0<p<l, (1) 

that & = 1; for each of its possible 2 K arguments. Also, for every site i, K 
inputs (the connections) are randomly selected from a uniform distribution 
among the N Boolean variables of the network, without repetition. So, for 
each site i, and each extraction E (0 < E < K — 1); an input j (1 < j < N) 
is extracted with probability 

{jfZTE, if j has not been previously extracted 
(2) 
0, if j has already been extracted 



Once the K inputs and the functions have been selected, a Boolean 
deterministic iVif-Kauffman network has been defined. It evolves determin- 
istically, and synchronously in time, according to the rules 

Si(t + 1) = 5, (S n (t), S i2 (t), S iK (t)) , i = 1, . . . , N, (3) 

where i m ^ i n , for all m, n — 1,2, ... , K, with m ^ n since, from (2), each 
input is different. iViT-Kauffman networks are then a special type of all the 
Boolean endomorphisms Bn] 

B N = {f:Z% ^Z?}. 

Let £^ be the set of jV/T-Kauffman networks. Then £^ C B N , and 
£jv ^ g N [3,4] _ j n j^ e f ^ a s ^ uc ]y Q f ^ ne injective properties of the map 

* : C N K ~* B N (4) 
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was pursuit. Using the fact that = , where Q 2 n is the set of functional 
graphs on 2 N points (i.e. the directed graphs with out-degree one, and loops 
allowed) ^ ; the average number i? (N, K) of elements in C 1 ^ that \1/ maps 
into the same Boolean function was calculated l 3,4 ' . The results showed that 
there exists a critical average connectivity K in the region K ~ O (In In N) 
for N ^> 1, given by 

such that ■& (N, K) e vN > 1 (if > 0) or -&(N,K) « 1, depending on 
whether K < K ox K > K, respectively. 

An important challenge, since the proposal by Kauffman of their net- 
works ^ , has been the analytic calculation of their average dynamics in terms 
of the network parameters: N, K, and p; their number, their connectivity, 
and their extraction bias, respectively. Until now only some special cases 
have been completely solved: The case K = N, the so-called random map 
model ' 5,6 1 , and the extreme case K — 1 ^ . 

In 1986, Derrida & Stauffer ® tried a mean field approach (where 
N — » oo) to study the problem. They showed that there exists a critical 
connectivity K c , such that the Hamming distance between two nearby states 
grows or decays exponentially according to whether K > K c or K < K c , 
respectively; where K c is a critical connectivity given by the curve 

K c 2p(l-p) = l. (6) 

An equivalent derivation of (6) was also proposed more recently in Ref. [9]. 
One of the principal ingredients of both derivations is that the effect that 
the number of arguments, i. e. the connectivity K , excerpts over the Boolean 
functions of (3) grows in average as orders 2 K . This, while approximately 
true for K ^> 1, is rough when K ~ 1 which are the typical values of K c 
in (6) for the important zone p ~ 1/2; as a recent study of the Boolean 
functions in terms of their irreducibility degree has shown W. 

In Ref. [4], a classification of Boolean functions according to the number 
of their arguments which really have an influence on the output of the func- 
tions; has been proposed. It was called the irreducible degree of the Boolean 
functions. By its means equations like (5) had been possible to calculate ' 3 ' 4 '. 

The scope of the present work is to make a mean field analysis of (3) 
taking into account the Boolean function irreducibility. As we will see, the 
transition Derrida-Stauffer curve (6) is going to appear, for each p at bigger 
values of K: particularly in the p ~ 1/2 zone this effect will become more 
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pronounced, and will approached asymptotically to (6) in the extreme zones 
p ~ and p ~ 1 . 

The article is organized as follows: In Sec. 2 I write a combinatorial 
formulation for the dynamical equations (3), which allows to work in a frame 
more suitable for calculations. In Sec. 3 the concept of Boolean irreducibility 
is introduced, and quantitative expressions for the number of functions with 
a fixed degree of irreducibility are obtained. In Sec. 4 a mean field approach, 
taking into account Boolean irreducibility is established, and a new critical 
connectivity K c is found. In Sec. 5 the average of the degree of irreducibility 
plus the probability of change of a Boolean function is calculated. This allows 
to obtain the corrected-for-irreducibility critical curve K c . In Sec. 6 I set up 
my conclusions. In the appendixes, some properties of the combinatorial 
coefficients which are used in the work are quoted. 



2. Combinatorial Notation for NK- Automata 



Let us write the evolution equation (3) in a formal language elaborated in 
Refs. [3,4]; which is more suitable to understand the combinatorial structure 
of the iVif -Kauffman networks. Throughout the article: V5 , ,S'gZ 2 , S+S' G 
Z 2 is intended to be modulo 2. By [N] = {1,2,..., N} I denote the set of 
the first N natural numbers. 

Definition 1: 



denotes the collection of all the subsets of [N] with cardinality K (0 < 
K < N), arranged in some unspecified order a. 

Definition 2: 

Each element of £^ is called a K-connection set, and so may be 
denoted by 



with, i x < %2 < ■ • • < %k\ i m £ [N] (m — l,...,K). 
Definition 3: 

To each fT-connection set I associate a K-connection function 



Let 





{M 2 ,...,iA-} Q [N], 




(7) 
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which projects each Boolean variable S = (Si, . . . , Sn) G Z^ onto , 
and is defined by 

C*^ (S) = C*^ (Si,..., Sn) = (S^, . . . , S iK ) V S G Z^. 

Definition 4: 

A K-Boolean function is a map 

6 X : Zf -> Z 2 , (8) 
and its negation -bx is given by ~^b K = 6^ + 1. 
Definition 5: 

A i^-Boolean function (8) is completely determined by its truth table 
<B (b K ), given by 

<B (&#-) = [0-1,0-2, • • • ,o 2 x] , (9) 
where, a s G Z 2 , is the s-th image of (8); and 

K 

s = S (S) = 1 + ^ 5* l<s<2^. (10) 

i=i 

defines a total order among the possible 2 K inputs of the argument 
S G Zf of the if-Boolean function (8). 

There are 2 2 ^ K-truth tables *B (b K ). Each K-Boolean function can 
be, uniquely classified according to Wolfram's notation by an integer 
number n = 1, . . . , 2 2 given by I 4,10 ] 

2 K 
s=l 

which also defines a total order among the fT-Boolean functions. 
I add a superscript /i to each of the if-Boolean functions (8) and make 

the 

Definition 6: 

The set of all K -Boolean functions is given by 

E K = \bP:Z? ^Z 2 ) 22 . (11) 
1 J /i=i 
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I clarify our abstract notation by the all important example of the truth 
table (9), for the case K = 2; presented in Table 1. The first line represents 
their Wolfram's number //, indicated in boldface. At the bottom of the 
table: J stands for the logical meaning of each 2-Boolean function, with Si 
(i = 1, 2) representing the identity 2-Boolean function in the i-th argument 
of (10), while ->Si — Si + 1 its negation. The parameters A and uj, to be 
defined below, represent: the degree of irreducibility, of the corresponding 
2-Boolean function, and its weight; respectively. 
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Table 1. The 23 (b 2 ) truth tables of the sixteen 2-Boolean functions. 

The maps (8) and (7) may be composed to represent the map (3) (for 
each Boolean variable Si) by 



/->*(<*«) 1.0*1) 
Z ^ °JL> J* z 2 i = l,...,N; 

with and C*^ a ^ extracted randomly according to the rules (1) and (2) 
respectively. So, the evolution equation (3) may be rewritten as 

S i (t + l) = b f j? ) oC$ ai) (S(t)), i = l,...,N, 

which defines an endomorphism — > TL^ ; but a particular one due to the 
presence of the if-connection map C*^ ai \ So, for K < N; ^ B N = Q 2 n, 
and only for the case K = N (of the random map model); C% = Bn = 

This is about rewriting (3) in a combinatorial notation. Now, for its 
random construction this is formally done by: 

i) According to (2): Extracting each C*^"^ function (7), with equiprob- 
ability and without repetition, among the possible (^) i^-connection 
sets. 
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ii) According to (1): Extracting each from a probability distribution 
such that, in (9) o~ s = 1, (s = 1, . . . , 2 K ) with probability p; which is 
attained by the probability distribution 

U p {b K )=p"{l-pf K -" , (12) 

where oj = 0, 1, . . . , 2 K denotes the value of the weight function ui (bx) 
of bx, defined by 

u(b K ) = J2°s- (13) 

s=l 

The following disjoint decomposition is going to be important for the 
calculations of the next section: 

Hx= [J ^M, (U.a) 

ui=0 

where 

¥k M = {b K e E K I cu (b K ) = cu} (14.6) 

with cardinality 

#M")= PJ)- (14.c) 



3. Irreducible Boolean Functions 



In fact, not all of the i^-Boolean functions depend strictly on their K 
arguments. For example, for K — 2, in Table 1: Rules 1 and 16 (contradic- 
tion and tautology, respectively) do not depend on neither Si or 5*2 ; rules 4 
6, 11, and 13 depend only on one of the arguments; while the remaining 10 
depend on both Si, S 2 - Due to this fact, I do the following 
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i) A fT-Boolean function bx is irreducible on its m-th argument S m (m = 
\,...,K), iff exist an S e for which 

b K (Si, . . . , S m , . . . , Sk) = 1 + bx (Si, . . . , S rn + 1, . . . , Sk) , 

while, if this does not happen, the ^-Boolean function bx is reducible 
on the m-th argument S m . 
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ii) A fT-Boolean function bx is said to have a degree of irreducibility A (A = 
0, 1, . . . , K); if it is irreducible on A of their arguments and reducible 
on the remaining K — A. 

ra) If A = K, the i^-Boolean function is called to be totally irreducible. 

Let A (bx) denotes the function that gives the degree of irreducibility of 
b K) and A (0 < A < K) their possible values. Then E K may, also be, disjoint 
decomposed by 

K 

5k = |J Ik (A) , (15) 

A=0 

where 

1 K (X) = {b K eZ K \\(b K ) = \}. 

The cardinal coefficients (5 K (A) = #Tx (A) where calculated recursively, in 
Ref. [4] obtaining the formula 

MA)=(^)3a, (16) 

where <3a = A\ (A) is the number of totally irreducible A-Boolean functions. 
From (11), and taking cardinalities in (15); it can be shown that (16) obeys 
the recursion formula 

K 



A=0 V 7 



which may be inverted using Comtet's formulas ' n ' for the combinatorial 
coefficients (see Appendix A) obtaining 

^=E(-i) A - m Q)2-. (it) 

m=0 ^ ' 

All coefficients (5 K (A), but f3 K (0) = 2, grow with K. % K (0) consists exactly 

of the K- contradiction -it = b K and K-tautology r = b y K functions, with 
truth tables (9) given by 

8(-.r) = [p,0,...,0l, (18) 




and 

(19) 




respectively. 

On the other extreme, from (17) I obtain the asymptotic expression, 

- ' O («) , (20, 



22 K \ 2% K ~ 1 

for K ^> 1. This shows that, with respect to the normalized counting mea- 
sure, almost any .fT-Boolean function is irreducible. 

These facts show us that the "real connectivity" of a i^-Boolean function 
bx is not K, but A (&&-). However for big values of K the "real connectivity" 
becomes nearly K. Even though the curve for the phase transition given by 
(6), in the region p ~ 1/2 predicts values of the order K ~ 2 so; in this case 
the effect of irreducibility should be appreciable in a mean field treatment 
that takes into account the degree of irreducibility. Let us calculate the 
average value (A) of A as a function of p and K; which represents the average 
connectivity of the automata (3) with respect to the extraction probability 
(12). So 

K 

(A) = A (b K ) n p o w (b K ) = ^2 A n p° w (M 

i> K es K a=o b K et K W 

= a ^n P H £ i 

A=o uj=o b K e[% K (x)n^ K (uj)] 

K 2 K 

= E A J2 U p^ Qk(\w), (21) 

A=0 uj=0 

where 

eK {\,u>) = #[ZK(\)ny K (w)]. 

The calculation of the cardinality (A, u) is a difficult task that has been 
pursuit in Ref. [12] using algebraic theoretical tools to do the combinatorial 
counting. Here I quote the result and refer the interested reader to the 
bibliography l 12 ': 

'A 



x 5{[u2 m - K \-u2 m ~ K ) 

where for all a e R, 



2 m 

Lw2"^J/' 
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[ 1 if a = 
5(a) = \ 

(O ifa^O 

is Kronecker's delta, [a\ G Z the floor function, which denotes the greatest 
integer [a\ such that [a\ < a, Q) = 0, for m > A, and 0° = 1. With this 
aid, now it may be calculated (21), obtaining 

(X)=K (l-[l-2p(l-p)f <K. 

See Appendix B for manipulation of the combinatorial coefficients, and rep- 
resentations of Kronecker's delta in terms of them. 

For p ~ 1/2 the effect of (20) tends to dominate for K ^> 1, making 
(A) ~ K. Instead, for p near to or 1, the ^-Boolean function (18) or (19), 
respectively dominates (since contradiction and tautology are for each case 
the only functions to have a significant probability to be extracted); thus 
making (A) ~ 0. In Figure 1, a graph of (A) / K vs. p shows the behavior for 
different constant values of K. 

4. Mean Field Theory for iVX-Automata 



Now a main field approach (N — > oo) is developed to study the behavior 
of the Hamming distance of two initially nearby states S and S', with respect 
to the parameters K, and p of the NK- Automata. 

Definition 8: 

The Hamming distance d H between two states S, S' G is given by 

N 

d H (S, S') = £ (S + S[) , (22) 
i=i 

with the addition modulo 2. So, (22) counts the number of Boolean 
variables in Si, S[ G Z 2 which differ, no matters their i-th position. 

We want to see the evolution of dn (22) as the system evolves in time 
according to (3) starting with two arbitrary, but nearby, states S(0), S'(0) 
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at t — 0. Let us use the shorthand notation 

N 
i=l 

for the Hamming distance at time t. Let, also, dn(0) = eA" (with < e <C 1) 
be the initial distance among them, with e not scaling with N. The initial 
Hamming distance, is then such that 

1 < djy(0) < N, 

so for ^> 1, statistics may done. Since the Boolean functions and their 
connections are randomly chosen from (1), and (2), respectively: 

Each affected site i, such that Si(0) ^ ^(0); will affect, on average, K 
sites Ar = {ii, ■ ■ ■ , ix} Q [N\. The ii-th affected site (1 = 1,..., K) is going 
to be the argument of a fT-Boolean function bx which is a stochastic variable 
obtained from the probability distribution (12). So, b K is going to have a 
degree of irreducibility A (bx), and a probability of change P c (bx) due that 
one of their arguments has changed (to be calculated later). Averaging over 
K, the i-th affected site will increase or decrease the Hamming distance at 
time t — 1 by the stochastic factor 

E Pc(b K )X(b K ), 

where < $j < K. At t — 1 the Hamming distance grows (or decays), on 
average, according to 

d H (1) = jh (S t (l) + SJ(1)) = f> (5 4 (0) + ^(O)) , 
1=1 1=1 

Since all the sites i are equivalent in the definition (22) of the Hamming 
distance, I may order them so that the first eN give the contribution to 
djj{0) different from zero, obtaining 

eN 

<Mi) = X>i. 

i=i 

Due to the independence of each of the terms of the sum, I may apply the 
central limit theorem to, asymptotically, substitute X^^j by its average, 
thus obtaining the asymptotic approximation 

d H (1) » e N ($> « 5 TV (A (6^) P c (6^)> , (23) 



11 



where (A (&#) P c (6^)) is going to be calculated in the next Section. The 
relative error S r in the calculation of (23), is given in terms of the standard 
deviation a, of (A (bx) P c (Pk))] which, as long as A (bx) P c (bx) is a bounded 
stochastic variable; turns to be bounded. Then 



r (A (b K ) P c (6a-)) VeN ' 

and so vanishes in the limit N — > oo. 

We may apply the same arguments for any t in the derivation of (23), as 
long as 1 <C d H (t) <C N, continues to be true, obtaining 

d H (t + l)nd H (t) (X(b K ) P c (b K )). 

Solving for the initial condition d#(0) = e N we have, while 1 -C dn{t) <C N 
holds, the mean field equation for the evolution of Hamming distance 

d H (t) « eN exp {* In [A (X,p)]} , (24) 

where 

A(K,p) = (\(b K )P e (b K )). 

Now, from (24) we see that there is an exponential grow (or decay) in 
dfj(t) depending on whether A (K,p) is bigger (or smaller) than one; which 
divides the phase space of the parameters p and K in the regions 



> 1 Standing for a disordered phase, called chaotic. 

A(K,p) 

< 1 Representing an ordered, or frozen phase. 
While 

A(K c ,p) = l (25) 
represents the equation for the phase space critical transition boundary. 



5. Phase Space Diagram corrected for Boolean Decomposition 



I now study for which values of the parameters K, and p (25) holds. This 
is done calculating the average (A (bx) P c {^k))- Note aboard that, due to 
the fact that < (A (b K )) < K, and < (P c {b K )) < 1: A(K,p) < 1 for 
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K < 1. So AT > 1 is a necessary, but not sufficient, condition for chaotic 
behavior to be exhibited in A^-Kauffman networks. 

The probability that a fT-Boolean function bx changes; due that one of 
its arguments has changed P c (bx) is, by definition, given by 

P c (b K ) = 71 ( b * : (J ) 71 ( 6 * : a + 1 I (J ) ' ( 26 ) 

where n (bx '■ cr) is the probability to extract at random the value a G Z2 
from the images of the truth table (9) 23 (bK), and 7r (&x : a + 1 | cr) is the 
probability to extract at random the value -kx = <r + 1, from 23 (6rt); gi ven 
that cr has been previously extracted. Then, from (13) 

^ (6a: : <r) = 5 (cr + 1) + — 5 (cr) , 

while 

7T (6^ : CT + 1 I Cr) = Y, K IT (b K \ O + 1) , 

where 

YjK ~ 2^1' 

is a second extraction factor which appears since now there remain in the 
pool 2 K — 1 states S G to choose. Substituting in (26) I obtain 

P c (6a-) = P c °u ib K ) = 2S X '-, 

Now I may calculate (A P c ) = (A (&#-) -P c (6x)) much in the same way as 
(21): 



(A P c ) = U p ° u ( 6 *) X ( 6 * ) P - ° u ( 6 *) 

2 K K 



w=0 A=0 

Now, with by the aid of (B3) and (B5) of Appendix B 

(A P c ) = 2 Kp (1 - p) {l - 2p (1 - p) [1 - 2p (1 - p)f "- 2 } . 
is obtained. 
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So the critical transition curve (25) is given by 

2K c p(l-p){l-2p (l-p)[l-2p (l-p)] 2 ^ 1 - 2 } = 1. (27) 

Comparison with Derrida-Stauffer's result (6) shows the appearance of a 
new factor of order 0[1 — 2p(l — p)\ which accounts for the existence of 
irreducibility in the fT-Boolean functions. Figure 2 compares the graphs of 
(6) and (27). Now, due to the effect of irreducibility the transition occurs 
for each p at greater values of K. In particular, for the all important case 
p=l/2; 

K c = 2.62140224613. . .. 



6. Conclusion 

I have re-calculated the phase transition Derrida-Stauffer's curve for the 
AX-Kauffman networks ® by correcting the calculations for the effect of 
Boolean irreducibility in if-Boolean functions While it turns out not to 
be a big correction for this case, it is an important effect in many other aspects 
in the behavior of ATif-Kauffman networks, such as the injective properties 
of the function \1> (4), which maps the ATif-Kauffman networks set into 
the iV-Boolean functions set Bn ^'^ ■ 

Without doubt the degree A of irreducibility, Definition 7 (ii) should 
play an important role in the characterization of the AfAT-Kauffman networks 
dynamics as a function of the parameters N, K, and p. Work is in progress 
with these new tool. 
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Appendix A: Inversion Formula for Binomial Coefficients 

In Comtet's work, the following inversion formula is proved 
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For any two sequences of real numbers 

{/r}" =0 , and {g r }r= , n>0 

such that 



n 

' n 



r=0 
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V 



Then, it follows that the g r are given in terms of the f r through 



r=0 ^ ' 



Appendix B: Identities and checks for manipulating g K (\,u) 



It is useful for the calculations involving qk (A, u) to extend the definition 
of the combinatorial coefficients when the upper index a G R, and the lower 
index n E Z; by writing l 13 ': 

a(a-l)...(a-n+l) for n > 

Q \ n! — 

(51) 



for n < 



Which for the case a e Z gives ( a ) = if a < n. From (Bl), the following 
identity can be proved to hold, for any a e K, m, n G Z t 13 ' 

a V m> l = f a V a " n Y (52) 

m J \n J \nj \m — nj 
The Binomial Theorem for zgC comes to be 

, x f |z| < 1, for a G R 

™>o ( Vz G C for a G N U {0} 

where, 0° = 1. From (B3) the following useful Kronecker's delta represen- 
tations, for a G R, and a > may be obtained by deriving with respect 
to z and taking z — — 1 [where it is to be noted that the series (B3) still 
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converges for z = — 1 due to the alternating sign, and that (^) ~ O (m 1 a ), 
for m> 1] 1 13 1; 



*(«) = £ ( 1 ) ' *(«"!) = £ ("!) m+1 ™(") a > 0. (54) 

m>0 ^ 7 m>0 ^ 7 



Using (B2) and (B4) one easily obtain the following check identities for 
q k (A, a;), which are consequences of (14), (16) and (17): 



/2 X \ 

A=0 V 7 



and 



w=0 v 7 m=0 v 7 

From (B3) and (B4) also follows the useful identity 



K 



E Xqk(X,u) = K 



A=0 



2^ 



2 K-1 

LfJ 



(A) . 



(B5) 
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Figure caption 

Figure 1. (Color online), Graph of (A) /K vs. p, for constant values of 
K. It shows the behavior of the average degree of irreducibility of the 
^-Boolean functions E K with respect to the bias p. 

Figure 2. (Color online) Compares the graphs of the Derrida-Stauffer 
phase transition curve (6), which does not take into account the irre- 
ducible degree of i^-Boolean functions, with the graph of (27) which 
takes into account this effect. 
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